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A  note  on  Smale's  Global  Newton  Method 

A.  A.  Goldstein* 

We  have  previously  considered  Smale's  [1]  global  Newton  method  in  conjunction  with 
the  Kantorovich  inequalities  in  a  simple  setting.  Our  object  was  to  determine  a  class  of 
problems  for  which  the  method  could  be  expected  to  be  efficient.  We  now  repeat  this 
project  using  Smale's  [2]  estimates  at  one  point  instead  of  the  Kantorovich  estimate. 

The  power  of  Smale's  estimate  stems  not  only  from  the  fact  that  the  information  is  con- 
centrated at  one  point.  A  further  advantage  is  that,  in  contrast  with  the  Kantorovich 
inequalities,  no  estimate  of  the  norm  of  the  inverse  of  the  derivative  operator  by  itself  is 
needed.  Newton  step  lengths  can  be  small  even  if  the  derivative  operator  is  nearly  singular. 

The  algorithm  below  requires  only  local  information  for  its  implementation.  To  predict  its 
behaviour,  however,  certain  global  constants  are  needed.  These  constants  can  be  estimated 
on  a  thin  cylinder  containing  a  segment  joining  the  origin  and  the  initial  value  of  the  vector 
valued  function  for  which  we  are  seeking  the  root.  The  iteration  count  for  the  algorithm 
is  sensitive  only  to  the  parameter  ^7  defined  below. 

Theorem  1  (Smale  86  )  Assume  F  is  an  analytic  map  between  real  Banach  spaces  X 

and  Y.  That  is,  the  Frechet  derivatives  F*  '(x)  exist  for  all  x  E  X  and  k=l,2,3, Given 

xq  £  X,  assume  that  the  inverse  of  F'(x),  which  we  denote  by  F!_i{x),  exists.  Set 

(3{x0)  =  ||Fi1(a;o)i71(a:o)||  and 

7(*o)  =  suph^FL1{x0)Fik\x0)\\^  :  k  >  2} 

If 

0(*o)7(*o)   <   -130707 
then  xq  is  an  approximate  root  of  F.  That  is  the  Newton  sequence 

Xk+i  =xk-  F'_1(xk)F(xk) 

is  well  defined  and  {x^}  converges  to  say  £,  a  root  of  F  at  the  rate: 

N+i-**||    <    2(i)2V(:ro) 


supported  by  grants  NIH  RR01243-05  AND  NPS  LMC-M4E1 


Moreover, 

The  next  result  is  not  given  by  Smale  but  it  is  readily  calculated  using  his  ingredients.  In 
what  follows  we  shall  often  abbreviate  (3(xk)  (and  similar  expressions)  by  /?*• 

Remark  2 

||f(*t)ll    <    1.85||F'(x0)||         fc  =  1,2,3, 


Proof.    In  [2],  Proposition  2,  we  find  the  formula 

ajfc+i    <    <*k  /(2a?    -4ajt    +   1), 

where  ak  =  ^klk  <  1/8.  Then  Qk+i  <  (2  ak)2-  In  Smale's  proof  of  Lemma  2  we 
find  \\I-F!_1(xk)F*(xh+1)\\  <  (1-  ak)~2  1.  Whence  ||  /  -  Fl^a^Osfc+i)  II  < 
1   +   (11/4) o*.    Let    Hk  =  FL1(xk)F'(xk+1)   then    F'(xk+1)  =  F'(xk)Hk,  and 

||F'(x,+1)||    <    im*o)||  IR1    +   (H/4)(2a0)2') 

i=0 

We  can  improve  this  result  by  using  sharper  bounds  for    i=0    and  for    i=l,    namely,    .300 
and    .138,  respectively.  Then 

(°°  \  /«oo 

[](l    +   (11/4)(2qo)2')J    <    (11/4)  y     (l/4)2*<*r    <    .172 

Finally  we  have  the  estimate 

oo 

Y[\\Hk\\    <    1.85. 

Assume  the  hypotheses  of  Theorem  1 .  Let 

T  =  {x  e  X  :  \\F(x)\\    <   \\F(x0)\\}. 

We  assume  that  7(x),  F(x)  and  (3{x)  are  defined  and  can  be  calculated  throughout  T. 
Assume  the  existence  of  numbers  (3,  7,  K  and  a  that  bound  (3(x),  7(2"),  ||F'(a-)||  and 

a(x)  =  WF'^ix)- 


\\F(x[ 
3 


on  T.    Let    ]x[    denote  the  smallest  integer    >    x. 

Algorithm  3  Given  x,  6  T,  we  define  x,-+1  as  follows.  Set  t{  =  1  —  (87,^1  )_1,  where 
7,  =  7(2,)  and  fii  is  defined  similarly.  Set  £q  =  x,  and  run  the  Newton  sequence  for  G 
starting  at  £q.  Let  k  be  the  smallest  integer  satisfying 

G(Ck)   <   ||^(^)||/407,A 
Set  xl+1  -  i\. 

The  algorithm  can  be  run  and  terminated  with  a  posteriori  data,  without  any  knowledge 
of  the  values  of  the  constants  /?,  7,  <r,  and  K.  Moreover  to  verify  a)  and  b)  below  we  do 
not  use  these  constants.  However  the  global  behaviour  of  the  algorithm  as  described  in  c) 
and  d)  is  given  in  terms  of  these  constants.  Let  A',  =  1.85  ||F(x,)||. 

Claim  4 

(a)  Xj+i    can  be  found  in     S  —  ]  log2  (log2  (80  A',  71  (3?  /  ||F(x,)||))[    steps. 

(b)  \\F{xi+1)\\  <   (l-(l/107iA))||^t)ll 

(c)  Let    S    =    log2(log2(80A'7/?cr)).     Given  e  >  0,     if  k     >  ]10  yfiS  log2(l/e)[ 
then     (\\F(xk)/\\F(x0))    <  e. 

(d)  If     k     >    ]10  7/?Slog(8  7<7)[     then    Xk    is  an  approximate  root  of  F. 

Proof.  We  show  first  that  Xj+i  can  be  chosen  as  claimed.  Let  G*{x)  =  ttF(xl).  Then 
Xi  is  an  approximate  root  for  Gl.  Hence  if  £0  =  xt  and  £*+i  =  £ k  —  F'(^k)G(^k)  then 
£jt    converges  to    £l,    a  root  of   Gl.  We  now  prove  (b) 

We  have  that  Gl(xt)  -  G*{C)  =  G\xt)  =  (F(x,)  /  8/3,7.)  =  F(xt)  -  F(&).  Also, 
F(xi)-F(xi+1)  =  F(xi)-F(C)  +  G'iO-G^x^)  =  (F(Xi) / 8 0ni)  +  <?''(£■)  ~ 
G1(xl+i).     Thus    b)    is  true. 

We  now  prove    a)    by  counting  the  steps  needed  to  ensure  that 
||Gl(nil    <    ||F(*,-)ll/407iA    =   imp.    Since    G«(&)  =  F(&)  (fc+1  -  &) 
we  may  choose   k    to  ensure  that  2  A"*(|)2  /3(x,)    <    tmp 

To  prove    c)    replace  j3t  and  7$    by    j3  and  7,    respectively.  If  k    satisfies 
A;log2(l-(l/107W    <    «    then    (||F(x*)||/||F(x0)||)    <    e. 
To  go  from  k  to  k+1  requires  no  more  than  S  steps. 


We  now  turn  to  d).  If  ||.F(;r)||  <  -^-^  then  x  is  an  approximate  root  for  F.  Thus  we 
replace    1  /  e  in    c)  by    8  (77 

Remarks  5 

The  method  is  sensitive  only  to  the  number  7/?  ! 

Note  that  from  the  above  proof  -F(£l)  =  t,F(xt).  Since  xt+\  lies  near  £'  the  global 
constants  need  be  estimated  only  on  a  slender  tube  surrounding  the  segment  joining  the 
origin  and    F(xq). 
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